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O Abstract 

^— ' . We consider structural and algorithmic questions related to the Nash dynamics of weighted congestion 

games. In weighted congestion games with linear latency functions, the existence of pure Nash equilibria 

is guaranteed by potential function arguments. Unfortunately, this proof of existence is inefficient and 

computing pure Nash equilibria is such games is a PLS-hard problem even when all players have unit 

Lh ■ weights. The situation gets worse when superlinear (e.g., quadratic) latency functions come into play; in 

r •^ ' this case, the Nash dynamics of the game may contain cycles and pure Nash equilibria may not even exist. 

• . Given these obstacles, we consider approximate pure Nash equilibria as alternative solution concepts. Do 

fj ' such equilibria exist? And if so, can we compute them efficiently? 

We provide positive answers to both questions for weighted congestion games with polynomial la- 
tency functions by exploiting an "approximation" of such games by a new class of potential games that 
►-^ . we call ^ff-games. This allows us to show that these games have dl-approximate pure Nash equilibria, 

QQ ' where d is the maximum degree of the latency functions. Our main technical contribution is an efficient 

t:J" . algorithm for computing 0(l)-approximate pure Nash equilibria when d is a constant. For games with 

^^ \ linear latency functions, the approximation guarantee is '"^ ^ ^ + ^(7) for arbitrarily small 7 > 0; for 

latency functions with maximum degree d > 2, it is c;2d+o(d) rpj^^ running time is polynomial in the 
number of bits in the representation of the game and I/7. As a byproduct of our techniques, we also 
show the following interesting structural statement for weighted congestion games with polynomial la- 
tency functions of maximum degree d > 2: polynomially-long sequences of best-response moves from 
any initial state to a d'^^'' ^ -approximate pure Nash equilibrium exist and can be efficiently identified in 
such games as long as d is constant. 
^\f ' To the best of our knowledge, these are the first positive algorithmic results for approximate pure 

Nash equilibria in weighted congestion games. Our techniques significantly extend our recent work on 
unweighted congestion games through the use of ^-games. The concept of approximating non-potential 
games by potential ones seems to be novel and might have further applications. 
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1 Introduction 

Among other solution concepts, the notion of the pure Nash equilibrium plays a central role in Game Theory. 
Pure Nash equilibria in a game characterize situations with non-cooperative deterministic players in which no 
player has any incentive to unilaterally deviate from the current situation in order to achieve a higher payoff. 
Unfortunately, it is well known that there are games that do not have pure Nash equilibria. Furhermore, even 
in games where the existence of equilibria is guaranteed, their computation can be a computationally hard 
task. Such negative results significantly question the importance of pure Nash equilibria as solution concepts 
that characterize the behavior of rational players. 

Approximate pure Nash equilibria, which characterize situations where no player can significantly im- 
prove her payoff by unilaterally deviating from her current strategy, could serve as alternative solution con- 
cept^j provided that they exist and can be computed efficiently. In this paper, we present the first positive 
algorithmic results for approximate pure Nash equilibria in weighted congestion games. Our main contri- 
bution is a polynomial-time algorithm that computes 0(l)-approximate pure Nash equilibria under mild 
restrictions on the game parameters; these restrictions apply to important subclasses of games in which not 
even the existence of such approximate equilibria was known prior to our work. 

Problem statement and related work. In a weighted congestion game, players compete over a set of 
resources. Each player has a positive weight. Each resource incurs a latency to all players that use it; this 
latency depends on the total weight of the players that use the resource according to a resource-specific, non- 
negative, and non-decreasing latency function. Among a given set of strategies (over sets of resources), each 
player aims to select one selfishly, trying to minimize her individual total cost, i.e., the sum of the latencies 
on the resources in her strategy. Typical examples include weighted congestion games in networks, where 
the network links correspond to the resources and each player has alternative paths that connect two nodes as 
strategies. 

The case of unweighted congestion games (i.e., when all players have unit weight) has been widely 
studied in literature. Rosenthal ll27l proved that these games admit a potential function with the following 
remarkable property: the difference in the potential value between two states (i.e., two snapshots of strategies) 
that differ in the strategy of a single player equals to the difference of the cost experienced by this player in 
these two states. This immediately implies the existence of a pure Nash equilibrium. Any sequence of 
improvement moves by the players strictly decreases the value of the potential and a state corresponding to 
a local minimum of the potential will eventually be reached; this corresponds to a pure Nash equilibrium. 
For weighted congestion games, potential functions exist only in the case where the latency functions are 
linear or exponential (see ifTTl |2T1 l26l ). Actually, in games with polynomial latency functions (of constant 
maximum degree higher than 1), pure Nash equilibria may not exist ||2TI . In general, the problem of deciding 
whether a given weighted congestion game has a pure Nash equilibrium is NP-hard fT5^. 

Potential functions provide only inefficient proofs of existence of pure Nash equilibria. Fabrikant et al. 
lITSl proved that the problem of computing a pure Nash equilibrium in a (unweighted) congestion game is 
PLS-complete (informally, as hard as it could be given that there is an associated potential function; see 
ll22l ). This negative result holds even in the case of linear latency functions [1]. One consequence of PLS- 
completeness results is that almost all states in some congestion games are such that any sequence of players' 
improvement moves that originates from these states and reaches pure Nash equilibria is exponentially long. 
Such phenomena have been observed even in very simple weighted congestion games (see ||2l[l6l). Efficient 
algorithms are known only for special cases. For example, Fabrikant et al. [18] show that the Rosenthal's 
potential function can be (globally) minimized efficiently by a flow computation in unweighted congestion 
games in networks when the strategy sets of the players are symmetric. 



'Actually, approximate pure Nash equilibria may be more desirable as solution concepts in practical decision making settings 
since they can accommodate small modeling inaccuracies due to uncertainty (e.g., see the arguments in 1121 ). 



The above negative results have led to the study of the complexity of approximate pure Nash equilibria 
(or, simply, approximate equilibria). A p-approximate (pure Nash) equilibrium is a state, from which no 
player has an incentive to deviate so that she decreases her cost by a factor larger than p. In our recent work 
Q, we present an algorithm for computing 0(l)-approximate equilibria for unweighted congestion games 
with polynomial latency functions of constant maximum degree. The restriction on the latency functions is 
necessary since, for more general latency functions, Skopalik and Vocking ll28l show that the problem is 
still PLS-complete for any polynomially computable p (see also the discussion in fT\). Improved bounds are 
known for special cases. For symmetric unweighted congestion games, Chien and Sinclair [1 IJ prove that the 
(1 + e) -improvement dynamics converges to a (1 + e)-approximate equilibrium after a polynomial number of 
steps; this result holds under mild assumptions on the latency functions and the participation of the players in 
the dynamics. Efficient algorithms for approximate equilibria have been recently obtained for other classes 
of games such as constraint satisfaction |5, 25], anonymous games [14|, network formation li3J, and facility 
location games llH. 

In light of the negative results mentioned above, several authors have considered other properties of the 
dynamics of congestion games. The papers [4i[l9l|23 consider the question of whether efficient states (in the 
sense that the total cost of the players, or social cost, is small compared to the optimum one) can be reached by 
best-response moves in linear weighted congestion games. In particular, Awerbuch et al. H show that using 
almost unrestricted sequences of (1 + e)-improvement best-response moves, the players rapidly converge to 
efficient states. Unfortunately, these states are not approximate equilibria, in general. Similar approaches 
have been followed in the context of other games as well, such as multicast tOjilOJ, cut [il3i| . and valid-utility 
games 1241 . 

Our contribution. To the best of our knowledge, no efficient algorithm for computing approximate equilibria 
is known for (any broad enough subclass of) weighted congestion games. We fill this gap by presenting an 
algorithm for computing 0(l)-approximate equilibria in weighted congestion games with polynomial latency 
functions of constant maximum degree. For games with linear latency functions, the approximation guarantee 
is '^^2 + ^(7) fo'' arbitrarily small 7 > 0; for latency functions of maximum degree d > 2, it is c^2d+o(d) 
The algorithm runs in time that is polynomial in the number of bits in the representation of the game and I/7. 

This result is much more surprising than it looks at first glance. In particular, weighted congestion 
games with superlinear latency functions do not admit potential functions, the main tool that is exploited 
by all known positive algorithmic results for (approximate) equilibria in congestion games. Given this, it 
is not even clear that 0(l)-approximate equilibria exist. In order to bypass this obstacle, we introduce a 
new class of potential games (that we call ^-games), which "approximate" weighted congestion games with 
polynomial latency functions in the following sense, ^-games of degree 1 are linear weighted congestion 
games. Each weighted congestion game of degree d > 2 has a corresponding ^-game of degree d defined in 
such a way that any p-approximate equilibrium in the latter is a dip-approximate equilibrium for the former. 
As an intermediate new result, we obtain that weighted congestion games with polynomial latency functions 
of degree d have dl-approximate equilibria. 

So, our algorithm is actually applied to ^-games. It has a simple general structure, similar to our recent 
algorithm for unweighted congestion games Q, but has also important differences that are due to the depen- 
dency of the cost of each player on the weights of other players. Given a ^-game of degree d and an arbitrary 
initial state, the algorithm computes a sequence of best-response player moves of length that is bounded by a 
polynomial in the number of bits in the representation of the game and I/7. The sequence consists of phases 
so that the players that participate in each phase experience costs that are polynomially related. This is cru- 
cial in order to obtain convergence in polynomial time. Within each phase, the algorithm coordinates the 
best-response moves according to two different but simple criteria; this is the main tool that guarantees that 
the effect of a phase to previous ones is negligible and, eventually, an approximate equilibrium is reached. 
The approximation guarantee is slightly higher than a quantity that characterizes the potential functions of 



^-games; this quantity (which we call the stretch) is defined as the worst-case ratio of the potential value 
at an almost exact pure Nash equilibrium over the globally optimum potential value and is almost ^ y ^ for 
linear weighted congestion games and d'^+°'y'^) for 'I'-games of degree d > 2. Our analysis follows the same 
main steps as in our recent paper ITJ but uses significantly more involved arguments due to the definition of 
^-games. 

We also present a similar but slightly inferior algorithm that is applied directly to weighted congestion 
games of maximum degree d > 2 and reveals a rather surprising structural property of their Nash dynamics: 
starting from any initial state, the algorithm identifies a polynomially-long sequence of best-response moves 
that lead to a d'^^'^ ^ -approximate equilibrium. Even though the definition of this algorithm does not make 
any use of properties of ^-games, the analysis is heavily based on them, similarly to the analysis of our main 
algorithm. 

We remark that, following the classical definition of polynomial latency functions in the literature, we as- 
sume that they have non-negative coefficients. This is a necessary limitation since the problem of computing 
a p-approximate equilibrium in (unweighted) congestion games with linear latency functions with negative 
offsets is PLS-complete for any polynomial-time computable p > 1 [7|. 

Roadmap. We begin with preliminary general definitions in Section |2] Section |3]is devoted to 'f-games and 
their properties. We present our algorithm and its analysis in Section |4] and conclude with open problems in 
Section |5] Due to lack of space, most of the proofs as well as our structural result appears in Appendix. 

2 Definitions and preliminaries 

In general, a game can be defined as follows. It has a set of n players J\f; each player u £ J\f has a set of 
available strategies S^. A snapshot of strategies, with one strategy per player, is called a state. Each state 
S G riueA^ ^" incurs a positive cost Cu{S) to player u. Players act selfishly; each of them aims to select 
a strategy that minimizes her cost, given the strategies of the other players. Given a state S and a strategy 
s^ G Tiu for player u, we denote by {S-u, s'„) the state obtained from S when player u deviates to strategy 
s'^. For a state S, an improvement move (or, simply, a move) for player u is the deviation to any strategy 
s'^ that (strictly) decreases her cost, i.e., Cu{S-u, s'^) < Cu{S). For p > 1, such a move is called a p-move 
if it satisfies Cu{S-u, s'^) < '^" . A best-response move is a move that minimizes the cost of the player 
(of course, given the strategies of the other players). So, from state S, a move of player u to strategy s„ 
is a best-response move (and is denoted by BlZu{S)) when Cu{S-u: s'u) = miiisgEu Cu{S-m s). A state S 
is called a pure Nash equilibrium (or, simply, an equilibrium) when Cu{S) < Cu(5_„, s'^) for every player 
u ^ J\f and every strategy s'^ G $]„, i.e., when no player has a move. In this case, we say that no player 
has (any incentive to make) a move. Similarly, a state is called a p-approximate pure Nash equilibrium 
(henceforth called, simply, a p-approximate equilibrium) when no player has a p-move. Also, a state is 
called a p-approximate equilibrium for a subset of players A C A/" if no player in A has a p-move. We use 
the term Nash dynamics of a game in order to refer to the directed graph with nodes that correspond to the 
possible states of the game and directed edges that indicate improvement player moves; pure Nash equilibria 
correspond to sinks of the Nash dynamics. 

A weighted congestion game Q can be represented by the tuple {N,E, {wu)u&j\r^ {"^ujueN^ (/e)ee£)- 
There is a set of n players M and a set of resources E. Each player u has a positive weight Wu and a set of 
available strategies S^; each strategy s„ in S^ consists of a non-empty set of resources, i.e., s„ C 2^ . Each 
resource e G -E has a non-negative and non-decreasing latency function /e defined over non-negative reals, 
which denotes the latency incurred to the players using resource e; this latency depends on the total weight 
of players whose strategies include the particular resource. For a state S, let us define Ne{S) to be the multi- 
set of the weights of the players that use resource e in S, i.e., N(.{S) = {wu '■ u ^ M such that e G s^}. 
Also, we use the notation L{A) to denote the sum of the elements of a finite multi-set of reals A. Then, 



the latency incurred by resource e to a player u that uses it is f(.{L{N(,{S))). The cost of a player u at 
a state S is the total latency she experiences at the resources in her strategy Su multiplied by her weight, 
i.e., Cu{S) = WuYle&s fe{L{Ne{S))). We consider weighted congestion games in which the resources 
have polynomial latency functions with (integer) maximum degree d > 1 with non-negative coefficients. 
More precisely, the latency function of resource e is fe{x) = ^k=o^<^,kX^ "^ith a^^k ^ 0. The special 
case of linear weighted congestion games (i.e., with latency functions of degree 1) is of particular interest. 
In general, the size of the representation of a weighted congestion game is the number of bits required to 
represent the parameters a^^k of the latency functions, the weights of the players, and their strategy sets. In 
weighted congestion games in networks, the network links are the resources. Each player u aims to connect 
a pair of nodes {su,tu) and her strategies are all paths connecting s„ with t^ in the network. Note that 
the representation of such games does not need to keep the whole set of strategies explicitly; it just has to 
represent the parameters ae^fc> the weight and the source-destination node pair of each player, and the network. 
Unweighted congestion games (i.e., when Wu = I for each player u G J\f) as well as linear weighted 
congestion games are potential games. They admit a. potential function ^ : Ylu ^« '~^ ^~^' defined over all 
states of the game, with the following property: for any two states S and {S-u, s'^) that differ only in the 
strategy of player u, it holds that <l>(5_„,s'„) — ^{S) = Cu{S-u,s'u) — Cu{S). Clearly, the local minima 
of the potential function correspond to states that are pure Nash equilibria. The existence of a potential 
function also implies that the Nash dynamics of the corresponding game is acyclic. Potential functions for 
the two classes of games mentioned above have been presented by Rosenthal |27| and Fotakis et al. |17|, 
respectively. Unfortunately, weighted congestion games with polynomial latency functions of degree at least 

2 are not potential games and may not even have pure Nash equilibria EH. 

3 ^-games 

Our aim in this section is to define a new class of games which we call ^-games and study their properties. 
We will need the following interesting family of functions which have also been used in lH in a slightly 
different context. 

Definition 3.1 For integer k > 0, the function ^k mapping finite multi-sets of reals to the reals is defined 
as follows: ^k{^) = ^ for any integer k >\, ^o(^) = ^ for any (possibly empty) multi-set A, and for any 
non-empty multi-set A = {ai, a2, •••, a^} and integer k > 1, 



^kiA) = ki Yl H"* 



l<di<...<dk<it=l 

So, ^A;(A) is essentially the sum of all monomials of total degree k on the elements of A. Each term in 
the sum has coefficient kl. Clearly, "^i{A) = L{A). For k > 2, compare ^fc(A) with L(A)^ which can 
also be expressed as the sum of the same terms, albeit with different coefficients in {1, ..., A;!}, given by the 
multinomial theorem. 

We are ready to define ^-games. A ^-game Q of (integer) degree d > 1 can be represented by the tuple 
{M, E, {wu)ueAf, {^u)ueAfj («e,fc)eeB,fc=o,i,...,d)- Similarly to weighted congestion games, there is a set of n 
players J\f and a set of resources E. Each player u has a weight Wu and a set of available strategies S^; each 
strategy Su G Su consists of a non-empty set of resources, i.e., s„ C 2^. Each resource e is associated with 
d + 1 non-negative numbers Og ^ for A; = 0, 1, ...,d. Again, for a state S, we define N(,{S) to be the multi-set 
of weights of the players that use resource e at state S. Then, the cost of a player u at a state S is defined as 



Cu{S) = Wu ^ ^ae,fc^fc(A^e(5)). 



eSSu fc=0 



Of course, the general definitions in the beginning of Section |2] apply also to ^-games. With some abuse in 
notation, we also use to refer to the pseudo-state in which no player selects any strategy and S7^n(0) to 
denote the best-response of player u assuming that no other player participates in the game. 

Clearly, given a weighted congestion game with polynomial latency functions of maximum degree d, 
there is a corresponding 'I'-game with degree d, i.e., the one with the same sets of players, resources, and 
strategy sets, and parameter a^^k for each resource e and integer k = 0,1, ...,d equal to the corresponding 
coefficient of the latency function /g. Observe that ^-games of degree 1 are linear weighted congestion 
games. As we will see below, in a sense, a ^-game of degree d > 2 is an approximation of its corresponding 
weighted congestion game. 

We remark here that a different approximation of weighted congestion games has been recently con- 
sidered by Kollias and Roughgarden [23 1. Given a weighted congestion game, they define a new game by 
answering the following question: how should the product of the total weight of the players that use the 
resource times its latency be shared as cost among these players so that the resulting game is a potential 
game? Their games use a different sharing than the weight-proportional one used by weighted congestion 
games. In contrast, our approach is to define an artificial latency on each resource e (by replacing the term 
ae^kL{Ne{S))^ with ae_A:^fc(-^e(5')) in the latency functions) so that weight-proportional sharing yields a 
potential game. This guarantees the relation between approximate equilibria in weighted congestion games 
and ^-games presented in Lemma [33] below, which is crucial for our purposes. 

Properties of ^-games. We begin with a very important property of ^-games. 

Theorem 3.2 The function ^{S) = X^e Sfc=o fc+T^'^+i("^<=('^)) i^ '^ potential function for ^ -games of 
degree d. 

As a corollary, we conclude that the Nash dynamics of ^I'-games are acyclic; hence, these games admit 
pure Nash equilibria. Recall that ^-games of degree 1 are linear weighted congestion games; for this specific 
case. Theorem 13. 21 has been proved in fTTl. 

In the following, we study the relation between the approximation guarantee of a state for a ^-game and 
its corresponding weighted congestion game with polynomial latency functions. 

Claim 3.3 Consider a weighted congestion game with polynomial latency functions of degree d and its cor- 
responding '^-game. Then, for each player u and state S, Cu{S) < Cu{S) < d!c„(5). 

Using Claim [331 we can obtain a relation between approximate equihbria as well. 

Lemma 3.4 Any p-approximate pure Nash equilibrium for a ^-game of degree d is a dip-approximate pure 
Nash equilibrium for the corresponding weighted congestion game with polynomial latencies. 

Since pure Nash equilibria always exist in ^-games, the last statement (applied with p = 1) implies the 
following. 

Theorem 3.5 Every weighted congestion game with polynomial latency functions of maximum degree d has 
a d\-approximate pure Nash equilibrium. 

Subgames and partial potentials. We now define restrictions of the potential function of ^-games. Given 
a state S and a set of players A C M, we denote by N^{S) the multiset of the weights of players in A that 
use resource e in S. Then, we define 



^^('5) = EE^^^+i(^e^(^))- 



fc=0 



We can think of ^^ as the potential of a subgame in which only the players of A participate. 

We also use the notion of the partial potential to account for the contribution of subsets of players to the 
potential function. Consider sets of players A and B with B C A C J\f. Then, the S-partial potential of the 
subgame among the players in A is defined as 

When A = M, we remove the superscript from partial potentials, i.e., ^b{S) = <5-g (5). Also, when B 
is a singleton containing player n, we simplify the notation of the partial potential to ^^{S). Furthermore, 
observe that ^^{S) = $^(5). 

The next four claims present basic properties of partial potentials. 

Claim 3.6 Let S be a state of a ^-game and let B (^ A C J\f. Then, $^(S') < ^b{S). 

Claim 3.7 Let A ^ N be a set of players and let S and S' be states such that each player in A uses the same 
strategy in S and S'. Then, for every set of players B Q A, ^^{S) = <1>^(5'). 

Claim 3.8 Let S be a state of a ^-game and let u be a player Then, ^u{S) = Cu{S). 

Claim 3.9 Let u be a player and A <^ J\f a set of players that contains u. Then, for any two states S and S' 
that differ only in the strategy of player u, it holds that <l>yi(5) — ^a{S') = Cu{S) — Cu{S'). 

In particular. Claim [l!9l implies that the A-partial potential can be thought of as a potential function defined 
over all states in which each player mJ\f\A uses the same strategy. 

We proceed with the following interesting property that shows that the potential function of ^-games is 
cost-revealing. It also implies that the potential of a state lower-bounds the total cost of all players. 

Lemma 3.10 For every state S of a ^-game and any set of players A C J\f, it holds that <l>yi(S') < 

The stretch of the potential function. An important quantity for our purposes is the stretch of the potential 
function of ^I'-games; a general definition that applies to every potential game follows. 

Definition 3.11 Consider a potential game with a positive potential function ^ and let S* be the state of 
minimum potential. The p-stretch of the potential function of the game is the maximum overall p-approximate 
pure Nash equilibria S of the ratio ^{S)/^{S*). 

The next two statements provide bounds on the p-stretch of the potential function of ^-games of degree 
1 (i.e., linear weighted congestion games) and d > 2, respectively. 

Lemma 3.12 For every p £ [1, 11/10], the p-stretch of the potential function of a linear weighted congestion 
game is at most -^ — h 6(/9 — 1). 

Lemma 3.13 The p-stretch of the potential function of a '^-game of degree d > 2 is at most p{p + 1) {d + 

1)^+1. 

In the rest of the paper, we denote by 9d{p) the upper bounds on the p-stretch given by Lemmas 13.121 and 
|3l3l namely 9i{p) = ^^ + 6(p - 1) and 9d{p) = pip + l)'^{d + 1)^^+^. The next lemma extends these 
bounds to partial potentials. 

Lemma 3.14 Consider a ^-game of degree d and a state S which is a p-approximate pure Nash equilibrium 
for a set of players R C J\[. Then, <l>/j(5') < 6 dip)^ r{S*) for any state S* such that each player in M \ R 
uses the same strategy in S and S*. 

1 



4 The algorithm 

In this section we describe our algorithm (Algorithm 1; see the table below). The algorithm takes as input a 
^-game Q of degree d with n players, an arbitrary initial state S of the game, and a small positive parameter 
7. It produces as output a state of Q. The algorithm starts by initializing its parameters, namely Cmax. Cmin. rn, 
g, q, and p (lines 1-6). It first computes the minimum possible cost Cmin among all players and the maximum 
cost Cmax experienced by players in the initial state S. Then, it sets the parameter m equal to log (cmax/cmin); 
in this way, m is polynomial in the number of bits in the representation of the game (i.e., polynomial in the 
number of bits necessary to store the parameters ae,k and the weights of the players). Then, the parameter q is 

set close to 1 (namely, 5 = 1 + 7) and parameter p is set close to Ofi{q) (namely, p = ( ^-pr — 27 j ). Recall 
that 9d{q) is the bound on the g-stretch of the potential function of \I'-games of degree d in the statements of 
Lemmas [3II2 (for d = 1) and|3l3](for d > 2). 



input : A ^-game Q of degree d with a set M of n players, an arbitrary initial state S, and 

7 > with 7 G (0, 1/10] if d = 1 and 7 G (0, gg^], otherwise 
output: A state of Q 

1 Cmin ^ min„eA^c„(0_„,;B7?.„(0)); 

2 Cmax ^ max„gArc„(5); 

3 m ^ log(Cmax/Cmin); 

4 g ^ 2 {1 + m{l + -f~^)y d'^n-f-^; 

5 q^l+r, 

7 for i ^ to m do bi <— Cmax5~'; 

8 while there exists a player u ^ N such that Cu{S) G [61 , +00) and 

Cu{S^u,l3nu{S))<Cu{S)/q do 

9 I s^{S-u,i3nuis)y, 

10 end 

11 F ^ 0; 

12 for phase i ^ Ito m — 1 do 
while there exists a player u ^ N'\F such that either Cu{S) G [6^, +00) and 
Cu{S^u,13TZu{S)) < Cu{S)/porCu{S) G [6j+i,6i) and Cu{S-u,STZu{S)) < Cu{S)/q 
do 

14 I S ^ {S-u,BlZu{S)); 

15 end 

16 F^FU{nGAA\F:c„(S) G [6i,+oo)}; 

17 end 
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Algorithm 1: Computing approximate equihbria in ^-games. 

Then, the algorithm runs a sequence of phases; within each phase, it coordinates best-response moves of 
the players. This process starts (line 7) by computing a decreasing sequence of boundaries 60. ^i> ^2> ■■■> ^m 
that will be used to define the sets of players that are considered to move within each phase. Then, it executes 
phase (lines 8-10). During this phase, as long as there are players of cost at least 61 that have a q-move., they 
play a best-response strategy. Hence, after the end of the phase, all players with cost higher than 61 are in a 
g-approximate equilibrium. Then, the algorithm uses set F to keep the players whose strategies have been 
irrevocably decided; F is initialized to in line 11. Phases 1 to m — 1 (lines 12-17) constitute the heart of 
our algorithm. During each such phase i, the algorithm repeatedly checks whether, in the current state, there 



is a player that either has cost higher than bt that has a p-move or her cost is in [6j+i, bi) and has a g-move. 
While such a player is found, she deviates to her best-response strategy. The phase terminates when no 
such player exists and the algorithm irrevocably decides the strategy of the players that have cost at least 6j. 
These players are included in set F; at this point, they are guaranteed to be at a ^-approximate equilibrium. 
Subsequent moves by other players may either increase their cost or decrease the cost they could experience 
by deviating to another strategy. As we will show, these changes are not significant and each player will still 
be at an almost p-approximate equilibrium at the end of all phases. The fact that plays a crucial role towards 
proving such a claim is that, at the end of each phase i, any player with cost in [6j+i, bi) is guaranteed to be 
in a g-approximate equilibrium. Note that bm < Cmin and, eventually, all players will be included in set F. 

We remark that the sequence of the phases is similar to the one in our algorithm for unweighted conges- 
tion games with polynomial latency functions of constant degree d in [7|. However, there is an important 
difference. In that context, each player is considered to move during only two consecutive phases; these 
phases are defined statically based only on the characteristics of the particular player. The main reason that 
allows this is that the cost that a player may experience by following a specific strategy may change by at 
most a polynomial factor (namely, at most n*^) during the execution of the algorithm. This is not the case in 
the context of ^-games since the fact that the cost of a player depends on the weights of the other players 
does not satisfy this polynomial relation. So, in the current algorithm, the players that are considered to move 
within each phase are decided dynamically based on the cost they experience during a phase. In this way, a 
player may (be considered to) move in many different phases. 

Below, we will prove the following statement. 

Theorem 4.1 Algorithm 1 computes a p^-approximate equilibrium for every ^-game of constant degree d, 
where pi = -^^ — h 0(7) and pd € d +°'^. The running time is polynomial in 7"^ and in the number of 
bits in the representation of the game. 

Combined with Lemma [l4l Theorem l4. 1 l immediately yields the following result for weighted congestion 
games. 

Theorem 4.2 When Algorithm 1 is applied to the ^-game corresponding to a weighted congestion game with 
polynomial latency functions of constant degree d, it computes a state which is a p^-approximate equilibrium 
for the latter, where pi = ^^ + 0(7) and pd G d'^'^^"^''^ for d>2. 

The rest of this section is devoted to proving Theorem 14.11 Throughout the section we consider the 
application of the algorithm on a ^-game of degree d and denote by 5* the state computed by the algorithm 
after the execution of phase ifori = 0,l,...,m — 1. Also, we use Ri to denote the set of players that make 
at least one move during phase i. Our arguments are split in three parts. First, we present a key property 
maintained by our algorithm stating that the i?j-partial potential is small when the phase i > 1 starts. Then, 
we use this fact together with the parameters of the algorithm to prove that the running time is polynomial. 
The proof of the approximation guarantee follows. Recall that the players whose strategies are irrevocably 
decided during phase j > 1 are at a p-approximate equilibrium at the end of the phase. The purpose of the 
third part of the proof is to show that for each such player, neither her cost increases significantly nor the 
cost she would experience by deviating to another strategy decreases significantly after phase j. Hence, the 
approximation guarantee in the final state computed by the algorithm is slightly higher than p. 

We remark that the analysis follows the same general steps as in our recent paper on unweighted con- 
gestion games [7|. However, due to the definition of ^-games and the dependency of players' cost on the 
weights, different and significantly more involved arguments are required, especially in the first and third 
step. 

The key property maintained by our algorithm is the following. 



Lemma 4.3 For every phase i>l, it holds that $/j-(5*~^) < 'y^^nbi. 

We will now use Lemma |43] and the properties of ^I'-games to prove that the algorithm terminates quickly. 

Lemma 4.4 The algorithm terminates after a number of steps that is polynomial in the number of bits in the 
representation of the game and 7^^. 

Proof. Clearly, if the number of strategies is polynomial in the number of resources, computing a best- 
response strategy for a player u can be trivially performed in polynomial time (by the definition of c„). This 
is also the case for weighted congestion games in networks (where the number of strategies of a player can 
be exponential) using a shortest path computation. So, it remains to bound the total number of player moves. 
At the initial state, the total cost of the players and, consequently (by Lemma [3. 101) . its potential is at 
most ncmax- Each of the players that move during phase decreases her cost and, consequently (by Theorem 
13.21) . the potential by at least {q — l)6i = 75~^Cmax- Hence, the total number of moves in phase is at 
most wy^^g. For i > 1, we have <l>/j. (S"*) < nhiy^^ (by Lemma 1431 ). Each of the players in Ri that 
move during phase i decreases her cost and, consequently (by Claim [l!9l) . the i?j-partial potential by at least 
{q — l)6i+i = hiQ^^y. Hence, phase i completes after at most ngy^"^ moves. In total, we have at most 
mngy'"^ moves. The theorem follows by observing that g depends polynomially on m, n, and 7^^. D 

It remains to prove that our algorithm computes approximate equilibria. Our proofs will exploit Lemma 
I4.3l as well as the following lemma which relates the cost of a player in a state to the partial potential of two 
different subgames. 

Lemma 4.5 Consider a ^-game of degree d, a player u and a set of players R <^ J\f \ {u}. Then, for every 
state S and every e > 0, it holds that 

where ^, = (1 + l/e)'^(i'^ - L 

Using Lemmas 14.31 and 14.51 we will show that neither the cost of a player increases significantly after 
the phase at the end of which her strategy was irrevocably decided (in Lemma 1431 ) . nor the cost she would 
experience by deviating to another strategy decreases significantly (in Lemma l477l ). 

Lemma 4.6 Let u be a player whose strategy was irrevocably decided at phase j. Then, c„(S'™~^) < 
{l + 2y)cu{S^). 

Proof. For every i > j and e > 0, we apply Lemma 1431 for strategy 5*, player u, and the set of players Ri 
that move during phase i to obtain 

The equaUty holds by Claim l331 since the players in J\f\Ri do not move during phase i. The second inequality 
follows by Claim [331 The last one follows by Claim 1331 and since the i?j-partial potential decreases during 
phase i. 

We now set e = (1 + 7)^/"" - 1. This implies that (1 + e)"^ = 1 + 7. Also, by Claim |A21 (in 
Appendix lAt. we get e > ^(1 + 7)^/™^^ > (m(l + 7^^))^^ and, by the definition of the parameters g 
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and 7, ^^ = (1 + "^(1 + 7 ^))'^d'^ — 1 < ^ < 2(i+^-'^)n - Using the above inequality together with these 
observations, we obtain 

m— 1 

m—l 

m— 1 

< (1 + 7)4(5^') + (1 + l)Ce Y "^^^"' 

i=j + l 

m—l— J 

= (1 + 7)4(5^) + (l + 7-'K.n6, Y 9~' 

i=l 

The second inequality is obvious, the third one follows by Lemma 14.31 and by the relation between e and 
7, the equality follows by the definition of bi, the fourth inequality follows since g > 2 which implies that 
Yli>i 5 * ^ 2(7^^, the fifth one follows by our observation about ^^ above, and the last one follows since, by 
the definition of the algorithm, the fact that the strategy of player u is irrevocably decided at phase j implies 

that c„(S'J) >6j. D 

Lemma 4.7 Let u be a player whose strategy was irrevocably decided at phase j and let s'^ be any of her 
strategies. Then, c„(5'!!'~\ s^) > (1 - 27)c„(S'i„, s'„)- 

We are now ready to use the last two lemmas in order to prove the approximation guarantee of the 
algorithm. This will complete the proof of Theorem 14. II 

Lemma 4.8 Given a ^-game of degree d, the algorithm computes a p^-approximate equilibrium with pi < 
^^ + 0(7) and pd < d'^+°^'^\ 

5 Conclusions and open problems 

Due to lack of space, the modification of Algorithm 1 that yields our structural result for weighted congestion 
games with superlinear latency functions is presented in Appendix |D] 

Our work reveals interesting open problems. The obvious one is whether approximate equilibria with a 
better approximation guarantee can be computed in polynomial time. We believe that our techniques have 
reached their limits for linear weighted congestion games. However, in the case of superlinear latency func- 
tions, approximations of weighted congestion games by potential games different than ^-games might yield 
improved (existential or algorithmic) approximation guarantees. On the conceptual level, it is interesting to 
further explore applications of approximations of non-potential games by potential ones like the one we have 
exploited in the current paper. 
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A Two technical inequalities 



The following technical inequalities are extensively used in our proofs and are included here for easy refer- 
ence. 

Lemma A.l (Minkowski inequality) E?=i ("t + A)'' < ({EUiO^tY^^ + {EUi^tY^^) , far any in- 
teger k > 1 and at, fit > 0. 

Claim A.2 For every a G (0, 1) and z > 1, it holds that z" — 1 > a{z — l)z"~^. 

Proof. The function h{x) = x" is concave in [l,+oo). This means that, for every z > 1, the line con- 
necting points (1, 1) and {z, h{z)) has slope higher than the derivative of h at point z, i.e., ^jEy — a^"~^- 
Equivalently, z" — 1 > a{z — l)z"~'^. D 

B Omitted proofs from Section |3] 

The following lemma is proved in (the full version of) IS and is extensively used in our proofs. 

Lemma B.l For any integer k > 1, any finite multi-set of non-negative reals A, and any non-negative real b 
the fallowing hold: 

a. L(A)^ < M/fe(A) < k\L{A)'' d. ^k{A U {b}) - ^k{A) = kb-^kM^ U {b}) 

b. ^k-M)'' < ^fe(A)'-' e. ^k{A) < k^i{A)^k-M) 

c. ^k{A U {b}) = Eto W^b'^k-tiA) f. ^k{A U {b}) < (^fe({6})iA + M>,{Ay/'^f 

B.l Proof of Theorem |321 

Consider a player u, a state S in which u plays strategy Su and state {S^u,s'^) where u has deviated to 
strategy s(^. Using the definition of the potential function, we have 

d d 

$(5)-$(5_„,<) = j;^^^,+i(Ar,(5))-J^^^M.,+,(iV,(5_„,<)) 

e fc=0 e fc=0 

d 

eesu\s'u fc=0 
d 

+ E Eftt^'^'+'^^^^^^^"'^'+'^^'^^^-"''"^^^ 

ees^\s„ fc=0 

d d 

d d 

= "'^ E E ae,k^k{Ne{S)) -Wu^Y^ ae,k-^k{Ne{S-u, <)) 
ees„ fc=0 eesjj fc=o 

^ Cu(«b j — c^i(o_^i, s^j. 

The third equality follows by Lemma lBTTb and the facts that Ne{S) = Ne{S-u, s'y)U{wu} for every resource 
e E s„ \ s'„ and N(.{S-u, s'u) = Ne{S) U {wu} for every resource e € s'„ \ s„. The last equality follows by 
the definition of c^. □ 
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B.2 Proof of Claim|33] 

We will use Lemma IbTTU and the definitions of Cu{S) and Cu{S). Let Su be the strategy of player u at state 
S. Using the first inequality of Lemma iBTTk . we have 

d d 

C„(5) = WuY^Yl <^e,kL{N,{S)f <W^Y.Y1 «e,fc^fc(iVe(S)) = C„(5). 
eGSu fc=0 eGSu fc=0 

Also, using the second inequality in Lemma lB?Tb . we have 

d d d 

£u{S) = w^Y^Yl ae,k-^k{Ne{S)) <WuY.Yl o.e,kk\L{N,{S)f < d\Wu Y, Y. '^e,kL{N,{S)f 

eSSu fc=0 ees„ fc=0 ees„ fc=0 

= d\cu{S). 

D 

B.3 Proof of Lemma 13.41 

Let S be p-approximate equilibrium for a ^-game of degree d, n a player and s'„ a strategy of u different than 
her strategy Su in S. Using the p-approximate equilibrium condition for player u and Claim [331 we have 

Cu{S) < Cu{S) < pCu{S^u, s'J = dip ■ CuiS-u, s'J. 

D 

B.4 Proof of ClaimlMl 

Let fc > 1 be an integer and consider a resource e which is used by at least one player of B in S. By the 
definition of ^k, observe that 'ifk{N^{S)) — ^k{]^e (S)) is equal to kl times the sum of all monomials of 
degree k among the elements of N^[S) that contain at least one element in N^{S). Similarly, "^f^{N(,{S)) — 
'^kiNe (S)) is equal to k\ times the sum of all monomials of degree k among the elements of Ne{S) that 
contain at least one element in Nf{S). Since N^{S) C Ne{S), we have that 

^k{N^{S))-^k{N^\''{S)) < ^k{Ne{S))-^k{Nf\''{S)). 

The inequality holds trivially (with equality) if no player from B uses resource e in S. Using this inequality 
and the definition of the partial potential, we have 



e k=0 
d 

e fc=0 



EE ^ (^fc+i(A^e(S)) - ^k^i{Nf\^{S))) = HS) - <P^\^{S) 



D 



B.5 Proof of Claim|3J] 

Observe that N^ (S) = N^ (S") for each resource e and any A' C A. By the definition of the potential 
of the subgame among the players of A' , we have <1>"^ {S) = $"^ (5'). Then, by the definition of the partial 

potential, ^^{S) = $^(5) - ^^\^{S) = ^^{S') - ^^\^{S') = ^^{S'). D 
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B.6 Proof of ClaimlM] 

Let Su be the strategy of player u in S. We use the definition of the partial potential, the definitions of 
the potential for the original game and the subgame among the players in A/" \ {u}, Lemma lB?Tl i. and the 
definition of Cu{S) to obtain 



cl>„(5) = ci,(5)-ci>A^\W(5) = 5]5]^(vI/,+i(Ar,(5))-vi;,+i(iV^\W(5)) 



e fc=0 

E E ^ (^,+l(iVe(5)) - ^,+i(iV,^\W(5))) =WuY^f;^ ae,,^fc(iVe(5)) 

eGSu fc=0 eSSu A:=0 

CuiS). 



a 



B.7 Proof of Claim 13:91 

We have 

<^a{S) - <^a{S') = $(5) - ^^\^{S) - <^{S') + ^^\^{S') = $(5) - <^{S') = Cu{S) - Cu{S'). 



The first equality follows by the definition of the j4-partial potential, the second one follows by Claim 
since each player inM \ A uses the same strategy in S and S' and the last one follows by Theorem |3.2| D 

B.8 Proof of Lemma IXIOl 

Let A = {ui,U2, ...,u\A\}- Let tIq = and At = {ui, ...,«<} for t = 1, 2, ..., \A\. Then, using the definition 
of the partial potential and Claims [3^61 and [XSl we have 



t=i 

\A\ \A\ 

= E<^^*"H5)<E'^-*(^) = E^-(^)- 

t=l t=l u&A 



D 



B.9 Proof of Lemma IXIIl 

Let S* be the state of minimum potential and 5 be a /^-approximate equilibrium. For each player u, we denote 
by Su and s* the strategies she plays at states S and S* , respectively. Using the p-approximate equilibrium 
condition Cu{S) < p ■ Cu{S-u, s* ), the definition of the cost of player u, and the definition of function ^i, 
we obtain 

^Cu{S) < pu;„ ^ (ae,i^i(iVe(5'-n,0) + ae,o) 

u ess; 

< pWu Y^ (ae,l^l(iVe(5) U {Wu}) + fle.o) 

ees* 

= pWu ^ (ae,l^l(iVe(5)) + ae,lWu + Oe.o)- 

ees* 
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By summing over all players, by exchanging sums, and using the definition of Ne{S*), we obtain 



u ees* 



e \ u:ees* u:eGs^ u:egsj 

pj^ (ae,l^l(iVe(5))^l(A^e(5*))+ae,l J] wl + ae,0^liNe{S*)) ] ■ 



n:eGs* 



We now apply the inequality xy < -^^^— ^y^ + ^^ 'h x^ that holds for any pair of non-negative x and y on 
the rightmost part of the above derivation to obtain 

u 



v:^ 7-3\/5 






Now, observe that ^i(A'^e('S'*))^ > J2u-ees* '^l ^OJ" every resource e. Furthermore, ^i{Ne{S*))'^ + 
E„:ees* ^« = MNeiS*)). Hcncc, we have " 

We now use the definition of '&(S'), the fact that for every player u and resource e G s„, it holds that 
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Wu < ^i(-^e(5')), and the definition of tlie cost of player u. We have 

'^(S) = ^(^^&2(iVe(5))+ae,0V&l(iVe(S))) 
e 

^ E(^ E ((6-2^/5KM'i(7Ve(5)) + (2^/5-4)u;2)+ae,o ^ t«J 
= {3-V5)Y,WuY,{ae,i^i{Ne{S)) + ae,o) + {V5-2)Y,ae,i Y. ^" 

u edSu e u-.edSu 

+ (\/5- 2)^06,0 E "^^ 

= (3-^/5)Ec„(5) + (^/5-2)Eae,l ^ u;^ ^ (^/5 - 2) ^a^.o J^ ^^.. 
By applying inequality ([T]) to the rightmost part of this derivation, we obtain 

e e u-.ediSu 

+(%/5-2)J^ae,o^i(A^e(5)) 
5-^/5 



2 



e \ \ M:eesu / / 



^ "^^$(5*) + (2^ - A)pY, (^*2(iVe(5)) + ae,0^l(iVe(5)) 



< 



e 

The last inequality implies that $(5) is not larger than _ ~ \-^^ ^ {S*) which can be easily proved to be 
at most {^^ + 6(p - 1)) <^{S*) when p G [1, 11/10]. D 



B.IO Proof of Lemma 1233] 

Consider a p-approximate equilibrium S* of a ^-game and let S* be the state of minimum potential. We 
denote by Su and s* the strategy of player u at states S and S* , respectively. 

By Lemma [3.10[ the p-approximate equilibrium condition Cu{S) < p ■ Cu{S-u, s* ), and the definition of 
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the potential function, we have 

-MS) < lE^uis) 

' " u 



M e6s* fc=0 

d 



e fc=0 u:e£s* 



We now use the fact that iVe(5'-«, <) ^ Ne{S) U {t(;„}, Lemma iBTTb. and the fact that "^t+iiNeiS*)) > 

(* + l)'E«:eGs*«^n+' to obtain 






e fc=0 -uiees* 

e fc=0 u:e€sl t=0 ^ '^^ 

e fc=0 t=0 ^ ' Miees* 

< E E «e.^ E (fc - t)!(t + 1), ^^-^(^e(^))^^+i(^^(^*)) 



d fc + 1 ^ . \ 

EE^Ef t )^^^^-^ms))MNeis*)). 



Using Lemma lBTTb (observe that it implies that ^t(A) < ^fc+i (^) ^+^ tor any non-negative integer t < k+l 
and multi-set of reals A), the binomial theorem, inequality a'^ + /3^ < (a + /3)^ for every a, /3 > and 
A > 1, and the definition of the potential function, we obtain 



fe+i 



-^(s) < EE£7TE(^tM^^+^(^^(^»'^^^+i(^^(^*))"^ 



e fc=0 t=l 

d 



e fc=0 ^ 



.d+l 
e k=0 

We now apply Minkowski inequality twice on the double sum at the rightmost part of this last inequality and 
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use the definition of tlie potential function to obtain 

( 1 1 V d+1 

\k=0 J \k=0 

( 1 1 , d+1 

/ d \ d+l / d \ d+l 

\ e fc=0 / \ e fc=0 / 

The above inequality yields 

($(5))^ < —, — ms*))^ . (2) 

(i + i/p)— -1 

1 / 1 d \ —1 

By Claim lA.2l we have (1 + l/p) d+i _ i > | pd+i (p + i) d+i ((f _)_ i) J Using this observation, inequality 



© imphes that 

as desired. D 

B.ll Proof of Lemma 1231 

In our proof, we will use the property 

k 

^k{AUB) = J2('l)'^k-t{A)^t{B) (3) 

for every two multi-sets of positive reals A and B. To see why Q holds, observe that the product 
"^ k-t{A)"^ t{B) equals {k — t)ltl times the sum of all products of monomials of degree k — t with elements 
of A with monomials of degree t with elements of B. 

Given state S in the original game, we define the ^-game (it", {wu)ueR, {T,u)ueR, {ae,t)eeE,t=o,...,d) with 



i.—t V / 



ae,t = 

k=t 

Observe that the parameters a^^k depend only on the strategies of players in AA \ i? in S". 

Now, given any state S" in the original game, we denote by 5' the state in the new game in which each 
player in R uses the strategy she uses in S' . We also use the notation c^ for the cost of a player n G i? in the 
new game and ^ for its potential function. 

We will first show that Cu{S') = Cu{S') for every state S' of the new game such that each player u € J\f\R 
uses the same strategy in S' and 5. Consequently, since state S is a /j-approximate equilibrium for the players 
in R in the original game, state 5 is a p-approximate equilibrium in the new game. We have 

d d d / \ 

ees„ t=0 ees„ t=0 k=t ^ ^ 

d k / K d 

= «;.EE«^.'«E( t )'^k-t{Nf\^{S'))%{N^{S')) = Wu^^ae,k^kiNe{S')) 

eesu fc=0 t=0 ^ ^ eesu fe=0 

= Cu{S'). 
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The first equality follows by the definition of Cu{S'), the second one follows since N(,{S') = N^{S') and 
by the definition of de,k, the third one follows by exchanging the sums and since each player mM\ R use 

the same strategy in states S and S' (hence, A'^e (S) = Ne {S')), the fourth one follows by equality Q, 
and the last one follows by the definition of Cu{S'). 
We now show that $(S") = ^r{S'). We have 



d 



e t=0 



' \t + l)\{t-k)l 



e t=0 k=t 



k 



= EE^E ( '+1 ) ^.-.(iV^\^(5'))*m(iVf (5')) 

e fc=0 t=0 ^ ^ 

= E E ^ E ( ' t M ^.+i-.(A^^^^(^'))^*(ivf (5')) 

e fc=0 t=l ^ ^ 

= EE^fEf ^tM^^+i-*(^^^''(^0)^.(A^f(so)-^m(A^^^^^^^ 

e fc=0 \t=0 ^ ^ / 

= EE^*^+i(^e^(^'))-EE^^^+i(^^'^(^')) 

e fc=0 e fc=0 

The first equality follows by the definition of ^{S'), the second one follows since Ne{S') = N^{S') and by 
the definition of ae,k, the third one follows by exchanging the sums and since each player inM \ R use the 
same strategy in states S and S', the fourth one follows by simply changing the counter in the rightmost sum, 
the fifth one is obvious, the sixth one follows by property Q, and the last two ones follow by the definition 
of the (partial) potentials. 

Since the state 5 is a p-approximate equilibrium for the new game, the bounds on the p-stretch established 
in Lemmas [3.121 and 13.131 imply that ^{S) < 6d{p)^{S*). By our last equality above, we obtain that 
^r{S) < 9dip)^RiS*) and the proof is complete. D 

C Omitted proofs from Section ID 

C.l Proof of Lemma HJ] 

In order to prove the key property maintained by our algorithm, we will need the following lemma which 
relates the i?j-partial potential to the cost they experience when they make their last move within phase i. 

Lemma C.l Let c{u) denote the cost of player u £ Ri just after making her last move within phase i > 1. 
Then, 
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Proof. Rename the players in Ri as ui,U2, ..., ui^j so that Uj is the j-th player that performed her last move 
within phase i > I. Also, denote by S^'^ the state in which player u 
andRl = {uj+i,Uj+2---,u\r^\} ior j = 0,1,2, ...,\Ri\ - 1. Then, 



within phase i > I. Also, denote by S^'^ the state in which player Uj performed her last move. Let K- '' 



The first three inequalities follow by the definition of the partial potential functions and the definition of sets 
Rj. The fourth inequality follows by Claim 1377] since players in J\f\Rl do not move after state 5*'-^ and until 
the end of the phase. The inequality follows by Claim 1331 and the last equality follows by Claim [3^ and the 
definition of c(u). D 

We now proceed to the proof of Lemma 1431 For the sake of contradiction, we assume that <l>/j^ (S^^^) > 
j~^nbi and we denote by Bi and Qi the set of players in Ri whose last move was a p-move and (/-move, 
respectively. Since each player in Pi decreases her cost by at least {p — l)c(n) during her last move within 
phase i (see Claim [J!9l ), we have 



^rAS') < <l>ij,(5-i)-(p-l)^cH. 



uePi 

By Lemma ICT] and the fact that each player in Qi experiences a cost of at most bi when she makes her last 
move within phase i, we have 

E ^(^) > '^R^is^) - E ^(") ^ ^«»(^^) - ^^- 

uGPi u£Qi 

Using the last two inequalities and our assumption, we obtain that 

^bAS') < <^RAS'~')-ip-l)^RAS') + {p-l)nb, 



which implies that 



< {i + {p- i)7)$i?,(5*-^) -{p- mRAs') 



^R.iSl < [-+7]^rAS'-'). 



Now, consider state 5"*^^ and let Xi and Yi be the sets of players in Ri with cost at least bi and smaller 
than bi, respectively. Notice that, by the definition of phase i — 1, S^~^ is a (/-approximate equilibrium for 
the players in X^. We construct a new ^-game of degree d among the players in J\f as follows. The new 
game has all resources of the original game; the parameters a^^k for these resources are the same as in the 
original game. In addition, the new game has a new resource e^ for each player u £ Yi; the parameters for 
this resource are ae„,o = h/wu and ae„,A: = for A: = 1, ..., d. Each player in J\f \Yi has the same set of 
strategies in the two games. The strategy set of player u € Yi consists of the strategy s„ she uses in S'*~^ as 
well as strategy s'„ U {cu} for each strategy s'^ 7^ Su she has in the original game. 

Let S^^^ be the state of the new game in which all players play their strategies in S^~^. Clearly, state 5*^^ 
is a g-approximate equilibrium for the players in Xi. Also, at state 5'^^, each player u e Yi experiences a 
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cost equal to the cost she experiences at state S**"^ of the original game, i.e., smaller than bi. In the new game, 
any deviation of u would include resource e^ and would increase the cost of player u to at least Wutte^fl = h. 
Hence, S**^^ is a q-approximate equilibrium for the players of Yi as well. We use l> to denote the potential 
of the new game. Since the players use the same strategies in states 5*^^ and 5'^^ and the parameters a^^k 
of the original resources are the same in both games, we have $/?. (5*"^) = ^ji.{S^~^). 

Now, let 5* be the state in which each player in M \Yi uses her strategy in S"* and the strategies for the 
players in Yi are defined as follows. Let n be a player of Yi and s'^ be the strategy she uses at state 5* of the 
original game. Her strategy in state S* of the new game is s'^ U {e„} if s'^ ^ Su and s„ otherwise. Observe 
that, by the definition of the partial potential, we have that the partial potential $/j-(5'*) of the new game at 
state 5* is by at most X^usF ote„,o^i(-^e„('S'*)) < nbi higher than the partial potential of the original game 
at state 5* (due to the contribution of the additional resources to the potential value). Hence, 

So, we have identified a state S^^^ of the new game which is a g-approximate equilibrium for the play- 
ers in Ri and another state S"* such that the players in J\f \ Ri use the same strategies in 5'~^ and 5** and 
^Ri{S^~^) > (^d{Q)^Ri{S^)- This contradicts Lemma [3.14l and. subsequently, it also contradicts our assump- 
tion <I>ij.(S*~^) > j~^nbi. The lemma follows. D 

C.2 Proof of Lemma KE 

In order to prove the lemma, we will need the following technical claim. 

Claim C.2 For any a, /S > and integer d > I, it holds that {a + 13 f+^ < (l + e)a'^+i + (l + l/e)'^(i'^/3'^+^ 

Proof. Consider the function h{a) = (a + (3)'^^^ — (1 + e)a'^'^^. By setting its derivative equal to 0, we 
obtain that it is maximized for a = /3 ((1 + e)^/'^ - l) ~ to the value /(^, ivrf-D^ '^'^^"^- ^y Claim |A.2[ we 
have that (1 + e)^/'^ - 1 > _^^^i_,y^ . Hence, h{a) < (1 + l/e)'^(i'^/3'^+^ as desired. D 

Now, let k be an integer such that l<k<d + l, Aa. multiset of reals, and 6 > 0. Using Lemma IbTIT . 
inequality a'*' + /?'*' < (a + /3)^ for every a, /? > and A > 1, and Claim IC21 we have 

^k{Au{b})-^k{A) < (^,,{{b})y^ + ^i>,{Ay/''y -^k{A) 

< {l + e)^km)+^e^k{A). (4) 

Also, let Q = TV \ (i? U {u}) and define 

A:=max{t-1,0} ^ ^ 
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for each resource e and t = 0, 1, ..., d + I. Also, let P be a possibly empty set such that P C i? u {u}. By 
the definition of function ^fc+i and by exchanging the sums, we have 



e k=0 

e k=0 t=0 ^ ^ 

d+1 d / / I 1 \ 



e i=0 fc=max{t-l,0} 

5^5;5e,^.«(S)). (5) 



e t=0 



By Claim|3l]and the definition of the partial potential we have Cu(S) = $„(5) = $(5) - $-^\-f">(5). 
Using the alternative expression for the potentials ^{S^ and <^\^'^^{S) (i.e., equality ©) as well as inequal- 
ity (HJl, we obtain 

C«(^) = EE^^-^-(^'^(^e'''^^"^(^))-^'^(^e''(5)) 
e fc=0 

= E E'^'^.^ (^fc(7Vf^^">(5)) - ^^^(A^f (5))) 

eesu k=\ 
d+1 



< Y.Y.^-^^{(^ + '^'^''(^e''HS))+(e^k{N^{S))). 



ees„ k=l 

The second equality follows since ^o(^) = 1 for every (possibly empty) multiset of reals A. Using the fact 
again together with the fact ^k{^) = for A; > 1, as well as the definitions of the potentials, we obtain 

d+l d+1 

Cu{S) < (l + 6)5]J]5e,,(^fc(iVW(5))-Vl/,(0))+C,^j;5e,,(^,(A^f(S))-M/, 
eSSu A;=0 eSSu A;=0 

d+1 d+1 

^ (1 + ^) E E ^e.'^' {'i'kiNtHs)) - ^,(0)) + c. E E ^^-^- (^^•(^i'(^)) - ^k 

e k=Q e k=0 

= (1 + e) (^ci>A^\«(S) - (|.-^\(«u{«}) (^)^ ^ ^^ (^^M\{u} (^) _ ^A^\(Ku{«}) (5)^ 
= (l + e)<I>^\«(5) + C,<\^">(5) 
and the proof is complete. D 
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C.3 Proof of Lemma |47] 

For every i > j and e > 0, we apply Lemma |43] for state (5!lj^^, s'„), player u, and the set Ri of players that 
move during phase i to obtain 



and, equivalently, 



Cu{S\,s'J > ^cj5rj,<)-^c^«,(5-i). 



The first equality in the derivation above follows by Claim 13.71 since the players in J\f \ Ri use the same 
strategies in states {S'iu , s'^) and {Sl_^, s'^) and since all players besides u use the same strategies in states 
(S"!^^, s'^) and 5*^^. The second inequality follows by Claim [331 and the last equality follows by Claim [X8l 
We now set e = (1 + 7)^/"" - 1. This implies that (1 + e)"™ = (1 + 7)""^ > 1 - 7- Also, by 
Claim IAT2I we get e > ^(1 + 7)1/"*^^ > (rn,(l + 7^^))^^ and, by the definition of the parameter g, 

^e = (1 + m{l + j^^Yd'^ — 1 < ^- Using the above inequality together with these observations, we obtain 

m—l 
m—l 

i=j+l 

m—l 

> (1 - j)cu{Si^, s'J -Ce Y^ nba~^ 

i=j+i 

m-l-j 

= (1 - j)cu{Sl^, s'J - Cenj~'^bj Y^ g-' 

4 = 1 

> (1 - 7)c„(5i„, s'J - 2i,n^-\g-^ 

> (l-7)c„(5i„,0-7'ft, 

The second inequality is obvious, the third inequality follows by Lemma 14.31 and by the relation between e 
and 7, the equality follows by the definition of 6j, the fourth inequality follows since g > 2 which implies 
that X]i>i 5 * — 2^^^, the fifth inequality follows by our observation about £,e above, the sixth inequality 
follows since 7 < 1/p (this can be seen by inspecting the values of 7 and p in the definition of the algorithm 
and the bound on 0^(1 + 7) provided by Lemma B. 131 ) and Cu{S^) is higher than bj when the strategy of 
player u is irrevocably decided at the end of phase j, and the last inequality follows since player u has no 
incentive to make a p-move at state S^ . D 
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C.4 Proof of Lemma |48] 

Consider the application of the algorithm to a ^-game and let u be any player whose strategy is irrevocably 
decided at the end of phase j of the algorithm. Also, let s'„ be any other strategy of this player. By Lemmas 
I4.6l and l477] and since, by the definition of the algorithm, player u has no incentive to make a p-move at state 
S^, we have 

c„(5— 1) ^ (1+27) c4ffl) ^ 1+27 /^ 1 ^.: 



CuiS'I^-\s'J - (I-27) Cu{Si^,s'J-l-2j\9,{l+j) 

Hence, the right-hand side of the above inequality upper-bounds the approximation guarantee of the algo- 
rithm. For d=l, the parameter 7 takes values in (0, 1/10]. Since 7 G (0, 1/10] and 6*1(1 + 7) = ^^^ + 67 
(see Lemma [3. 121) . by making simple calculations, we obtain that the algorithm computes a /5i -approximate 
equilibrium with 

^i<^ + 1107. 

For larger values of d, the algorithm uses 7 G (0, g^^^J . Since 6*^^(1 + 7) is non-decreasing in 7, we have 

that ( g,^^ ) - 27] < 16*^(2). Also, we have that 7 < 1/34 and hence ^j^ < |. By using the 
value for 0^(2) from Lemma l3.13[ we have that the algorithm computes a p^-approximate equilibrium with 

Pd < 3'^+^{d + 1)'^+! G d'^+o{d)_ □ 

D The structure of the Nash dynamics of weighted congestion games with 
superlinear latency functions 

Algorithm 1 identifies a short sequence of best-response moves in the ^-game on input. When the degree 
of the 'I' -game is higher than 1, the sequence may include non-improvement moves for the corresponding 
weighted congestion game. In this section, we present an algorithm that is applied directly to a weighted 
congestion game with polynomial latency functions of maximum degree d > 2. The algorithm (Algorithm 
2, see the table below) is very similar to Algorithm 1; the main difference is that decisions are based on the 
cost of the players in the original weighted congestion game (so c^ in Algorithm 1 has been replaced by 
Cu in Algorithm 2). In addition, the parameters q and p used by Algorithm 2 are higher than the ones used 
in Algorithm 1. The main reason is that the only available tool we have in order to guarantee convergence 
to an approximate equilibrium is the potential function of the corresponding ^-game. Hence, parameters q 
and p are sufficiently high so that the moves performed by Algorithm 2 are also improvement moves for the 
corresponding ^-game. Due to technical reasons, 7 is now restricted to smaller (but still constant) positive 
values. We remark that, in the description of Algorithm 2, BTZu denotes the best-response of player u in the 
weighted congestion game. 

The analysis of the algorithm will follow the same lines with the analysis of Algorithm 1 . Again, the main 
idea in the analysis is to show that the algorithm computes an approximate equilibrium for the corresponding 
^I'-game (with a slightly worse approximation guarantee) which is also an approximate equilibrium for the 
original weighted congestion game. Our main statement for Algorithm 2 is the following. 

Theorem D.l For every weighted congestion game with polynomial latency functions of constant maximum 
degree d > 2, Algorithm 2 identifies a sequence of best-response moves from any initial state to a pd- 
approximate equilibrium, where pd G d'-^^'^ >. The length of the sequence is polynomial in 7^^ and in the 
number of bits in the representation of the game. 
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In the following, we consider the application of the algorithm on a weighted congestion game with 
polynomial latency functions of degree d. We denote by S^ the state computed by the algorithm after the 
execution of phase i for i = 0,1, ...,m — I. Also, we use Ri to denote the set of players that make at least 
one move during phase i. Similarly to the analysis of the algorithm for ^-games, we first aim to show that 
the algorithm computes a d'^^'^ ^-approximate equilibrium for the corresponding ^-game. Then, the result 
will follow by Lemma [I4l 



input : A weighted congestion game Q with polynomial latency functions of maximum 


degree d with a set M oi n players, an arbitrary initial state S, and 


7e(O,(4-d!0,(2(d!)2))-^] 


output: A state of Q 


1 Cmin ^ min„eA^c„(0_„,e7^„(0)); 


2 Cmax ^ max„eA^ c„(5); 


3 m ^ log(Cmax/Cmin); 


4 g^2{l + m{l + -i'^)Yd'^n'y-^; 


5 q^d\{l + -t); 


6 p 


^( 1 2^Y ■ 


^ [dWa{d\<i) ^7j > 


7 for f ^ to m do 6i •(— Cmax5~*; 


8 while there exists a player u £ M such that Cu{S) G [6i, +oo) and 


Cu{S-u,Bnu{S))<Cu{S)/q do 


9 5^(5_.„e7^„(5)); 


10 end 


11 F ^ 0; 


12 for phase i -^ 1 to m, — 1 do 


13 


while there exists a player u G AA \ F such that either Cu{S) G [6j, +oo) and 




Cu{S-u,Bnu{S)) < Cu{S)/porCu{S) G [6^+1, 6^) and Cu{S-u,Bnu{S)) < c„(5)/g 




do 


14 


s^{S-u,Bnu{s)y, 


15 


end 


16 


F^FU{uGJ\f\F: Cu{S) G [h, +oo)}; 


17 end 



Algorithm 2: Computing approximate equilibria in weighted congestion games with poly- 
nomial latency functions. 

Again, the proof will use the same arguments as before. First, we prove the key property that the Ri- 
partial potential is small when the phase i > 1 starts. Then, we use this fact together with the parameters 
of the algorithm to prove that the running time is polynomial. The proof of the approximation guarantee for 
the corresponding ^-game follows. Again, the purpose of the third part of the proof is to show that for each 
player whose strategy is irrevocably decided at the end of phase j, neither her cost in the ^-game increases 
significantly nor the cost she would experience by deviating to another strategy decreases significantly after 
phase j. Hence, the approximation guarantee with respect to the ^-game in the final state computed by the 
algorithm is sUghtly higher than p. In our proofs, we use the terms 1^-cost and ^-cost in order to distinguish 
between the cost experienced by the players in the original weighted congestion game and the corresponding 
^-game. 

We will use the following fact that follows by Claim [331 



27 



Claim D.2 Let Q be a weighted congestion game with polynomial latency functions of degree d and Q' its 
corresponding '^-game. A p-move in Q is a p/d\-move in Q' . A p-approximate equilibrium in Q is a dip- 
approximate equilibrium in Q'. 

Proof. Let 5 be a state of Q and consider the deviation of player u to strategy s'^ which is a p-move. Then, 

Cu{S) > Cu{S) > pcu{S-u,s'J > —CuiS-u,s'J. 

Now, assume that state 5 is a p-approximate equilibrium for Q. For every player u and every strategy s'„, we 
have 

Cu{S) < dlcuiS) < dlpCu{S^u,s'J < d\pCuiS-u,s'u), 

i.e., 5 is a dip-approximate equilibrium for game Q'. D 

Since the parameters q and p used by our algorithm are strictly higher than d\, the above claim immedi- 
ately implies that the players that move in each step actually make an improvement move in the ^-game as 
well. 

D.l Proving the key property 

The key property maintained by Algorithm 2 is the following. 

Lemma D.3 For every phase i > 1 of Algorithm 2, it holds that ^i?. {S^~^) < 7~^n6j. 

Proof. In order to prove it, we will need Lemma ICT] Note that the proof of Lemma ICT] works for every 
sequence of improvement moves by players in a set Ri in a ^-game and does not depend on any particular 
algorithm. Since, in every phase i of Algorithm 2, the players of Ri do follow improvement moves in the 
^-game, the proof is valid in this case as well. 

Now, the argument proceeds very similarly to the proof of Lemma 14.31 We include the full proof 
here since many minor modifications are required. Again, for the sake of contradiction, we assume that 
$R^(5*~^) > 7~^n6j and we denote by Pi and Qi the set of players in Ri whose last move was a p-move 
and g-move (in the weighted congestion game), respectively. By Claim ID^ each player in Pi decreases her 
^-cost by at least {p/dl — l)c(n) during her last move within phase i. Hence, we have 

'^rAS') < <^RAS'-')-ip/d\-l)Y,ciu). 

ueP, 

Now, observe that each player in Qi experiences a VF-cost of at most 6j when she makes her last move within 
phase i, i.e., a ^-cost at most dlbi (by Claim 1331 ). Using this fact and Lemma ICTl we have 

^ c{u) > ^R^{S') - Y, c{n) > <^rAS') - dlnh. 
u^Pi ueQi 

Using the last two inequalities and our assumption, we obtain that 

$i?, is') < <^R, is'-') - (p/dl -!)<!> n, iS') + ip- d\)nhi 
< il + ip- d\)j)^n^iS'-') - ip/dl - 1)^rAS') 

which implies that 

■1 ^ ^ ^^.-1, 



'^rAS') < dl{-+j]^R^iS 
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Now, we adapt the argument used in the proof of Lemma 1431 in order to reach the desired contradiction. 
Consider state 5"*^^ and let Xi and Yi be the sets of players in Ri with VF-cost at least bi and smaller than 
bi, respectively. Notice that, by the definition of phase i — I and Claim ID^ 5*~^ is a dig-approximate 
equilibrium for the players in Xi (with respect to the ^I'-game). We construct a new ^-game of degree d 
among the players in J\f as follows. The new game has all resources of the original game; the parameters a^^k 
for these resources are the same as in the original game. In addition, the new game has a new resource e^ for 
each player u £ Yi; the parameters for this resource are ae„,o = dlbi/wu and ae„,fc = for /c = 1, ..., d. Each 
player in J\f\Yi has the same set of strategies in the two games. The strategy set of player u £ Yi consists of 
the strategy s„ she uses in 5*^^ as well as strategy s'^U{eu} for each strategy s'^ 7^ Su she has in the original 
game. 

Let S"*^^ be the state of the new game in which all players play their strategies in S"*^^. Clearly, state 
5*~^ is a (i!g-approximate equilibrium for the players in Xi (with respect to the ^-game). Also, at state 5*~^, 
each player u £ Yi experiences a ^-cost equal to the ^-cost she experiences at state S^~^ of the original 
game, i.e., smaller than dlbi. In the new ^-game, any deviation of u would include resource e^ and would 
increase the ^-cost of player u to at least Wude-^.o = dlbi. Hence, 5*^^ is a dlg-approximate equilibrium for 
the players of Yi as well. We use <§ to denote the potential of the new ^-game. Since the players use the 
same strategies in states 5"*^^ and 5*^^ and the parameters Oe,fc of the original resources are the same in both 
games, we have ^r^{S'-^) = <^r^{S'-'^). 

Now, let S^ be the state in which each player in M \Yi uses her strategy in 5"* and the strategies for the 
players in Yi are defined as follows. Let n be a player of Yi and s'^ be the strategy she uses at state 5* of the 
original game. Her strategy in state 5* of the new ^-game is s'„ U {e„} if s'^ 7^ Su and Su otherwise. Observe 
that, by the definition of the partial potential, we have that the partial potential $/j- (5*) of the new ^-game 
at state 5* is by at most J2ueY '^e„,o^i(-^eu(5'*)) < dlnbi higher than the partial potential of the original 
^-game at state 5* (due to the contribution of the additional resources to the potential value). Using these 
observations, our assumption, and the definition of parameter p, we have 

^R^S') < ^R„{S') + dlnb, < d! Q + 27) ^bAS'~') = ^! (^ + 27) ^R^S'-') = e^^^R^^^''') 

So, we have identified a state S**^^ of the new ^-game which is a dlf^-approximate equilibrium for the 
players in Ri and another state 5* such that the players in J\f \ Ri use the same strategies in 5*^^ and 5* 
and ^^.(5*"^) > 6d{dlq)^ji.{S'^). This contradicts Lemma [3.14l and. subsequently, it also contradicts our 
assumption <!>/?- (S"*^^) > j^^nbi. The lemma follows. D 

D.2 Bounding the running time 

We will now use Lemma 1531 and the properties of ^-games to prove that the algorithm terminates quickly. 
Again, we assume that each player can efficiently compute her best-response strategy at any state (including 
the pseudo-state 0). 

Lemma D.4 Algorithm 2 terminates after a number of steps that is polynomial in the number of bits in the 
representation of the game and 7"^. 

Proof. At the initial state, the W-cost of each player is at most Cmax- Hence, by Claim [331 the total ^-cost of 
the players and, consequently (by Lemma [3. lOI ). the potential of the initial state is at most dlncmax- By Claim 
ID.2[ each one of the players that move during phase decreases her ^-cost and, consequently (by Theorem 
13.21) . the potential by at least {q/d\ — \)bi = 75~^Cmax- Hence, the total number of moves in phase is at 
most dlnj^^g. For i > 1, we have <l>/j.(5*) < nbi^~^ (by Lemma 1531 ). By Claim 1531 each one of the 
players in Ri that move during phase i decreases her ^-cost and, consequently (by Claim[3]9]), the i?i-partial 
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potential by at least {q/d\ — l)6i+i = hg^^^. Hence, phase i completes after at most ng^^"^ moves. In 
total, we have at most mngj"^ moves (since 7^^ > dl). The theorem follows by observing that g depends 
polynomially on m, n, and 7"^. D 

D.3 Proving the approximation guarantee 

The proof of the approximation guarantee will use the following lemma (it is analogous to Lemmas 14.61 and 
14.7 1 in the analysis of Algorithm 1). 

Lemma D.5 Let u be a player whose strategy was irrevocably decided at phase j of Algorithm 2 and let s'^ 
be any of her strategies. Then, Cu{S"^^^) < (1 + 2j)cu{S^) and CuiS"^" , s'„) > (1 — 2'j)cu{S-'_u, ■^n)- 

Proof. The proofs of the two parts are identical to the proofs of Lemmas 14.61 and 14.71 respectively. All that 
needs to be changed is the justification of two inequalities. At the end of the proof of Lemma 1431 we used 
the inequality bj < Cu{S^). This holds in our case as well since the fact that the strategy of player u was 
irrevocably decided at phase j implies that Cu{S) > bj and, by Claim [331 we also have Cu{S) > Cu{S). 
Similarly, at the end of the proof of Lemma 14771 we used the inequalities 76^ < Cu{S^)/p < Cu{Si,^, s'^). 
What we need is essentially to show that inequality jbj < Cu{S-L^, s'^) holds. We have 

ibj < 7c„(5^) < Cu{S^)/p < Cu{Si_^, s'J < CuiSl^, s'J. 

The first inequality is due to the fact that the strategy of player u was irrevocably decided at phase j, the 
second one follows since 7 < 1/p, the third one follows since, at state S^, player u has no p-move in the 
original weighted congestion game, and the last one follows by Claim [331 D 

We are now ready to use the last lemma in order to prove the approximation guarantee. This will complete 
the proof of Theorem 14. II 

Lemma D.6 Algorithm 2 computes a d^ ' -approximate equilibrium for the weighted congestion game on 
input. 

Proof. Consider the application of the algorithm and let u be any player whose strategy is irrevocably 
decided at the end of phase j of the algorithm. Also, let s'„ be any other strategy of this player. We will show 
that c„(S""-^) < 6(d!)26irf(2(d!)2) • c„(S'™-\ <); the lemma will then follow since the bound for 6'd(2(d!)2) 
given by Lemma [3.13l is d^^'^ \ We have 



< d\ 

< d\ 



Cu[^—u 5 -Suj Cu(ib_^ ) -SmJ 

,(1 + 27) Cu{S^] 



(I-27) CuiSi^,s'J 



- (1-27) 

•l-27V^!^d((l + 7)(rf!)') ^ 
1 + 27 / 1 ^ "^ 

- ■i^2^\d\e,{2{d\f)~'^^ 

< 2{dlf^^9Mdlf) 

< 6idl)Hd{2{d\f). 
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The first inequality follows by Claim [331 the second one follows by Lemma 1531 the third one follows since, 
at state S^ , player u has no p-move in the original weighted congestion game and, consequently (by Claim 
ID.2I) . no dip-move in the ^-game, the equality follows by the definition of parameter p, the fourth inequality 
follows since 6d is non-decreasing, the fifth inequality follows by the definition of parameter 7, and the last 
inequality follows since 7 < 1/4. D 
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